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ABSTRACT 

The report contains empirically-based evaluations of 
four adult batjic education programed learning programs: How to Manage 
Your Money; Jobs; Looking Ahead in Life; and Safety. Measures of the 
amount learned from these programs indicate that, in general, they 
led to sufficient degrees of learning to justify their wider 
distribution to appropriate adult basic education students. More 
particularly, the Jobs and Safety programs led to relatively superior 
amounts of learning, while Money and Looking Ahead led to an adequate 
amount by previously established criteria. Students who used these 
programs and a sample of teachers for whom these programs are 
intended t,en€:rally evaluated them favorably. The error rates for all 
programs were «?rtremely low, indicating the.t the programs are 
successful by che error rate criterion. (Ai\thor/NH) 
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ADULT LEARNING CENTM 



The Adult Learning Center Is an organizational unit In the School 
o£ Education at North Carolina State Unlvetslty^ and Is an Integral 
part of the research and development program of the School of Education. 

Established In 1967 ^ the Center Is conmlttad to seeking new ways 
and means for facilitating the Intellectual grovth and development of 
adults. The multtdlsclp Unary activities carried out by members of 
the University faculty associated with the Center are addressed to 
comprehensive and rigorous studies of the most pressing needs and 
problems confronting adult education. Among the objectives of the 
Center Is the provision of national leadership In the development and 
implementation of experimental and demonstration projects which give 
promise of materially improving adult education programs. A major 
concern of the Center Is the development and dissemination of packaged 
Instructional materials and improved Instructional methods which are 
capable of being Institutionalized within operational adult education 
programs In public school systems. 

The Center maintains on the campus of North Carolina State 
University an adult learning laboratory^ the primary purpose of which 
is to further the use of programmed instructional materials among 
adults. Continuing research is conducted in the laboratory to deter- 
mine the capacity of programmed instructional materials to effectively 
and efficiently raise the educational levels of adults. 



ADDITIONAL INFORMATION 



For additional information regarding the Center^ please write to: 

Mr. D. Barry Lumsden^ Director 
Adult Learning Center 
P. 0. Box 5096 

North Carolina State University at Raleigh 
Raleigh; Iforth Carolina 27607 



EMPIRICALLY- MSED EVALUATIONS OF: 



1. HOW TO MANAGE YOUR MONEY 
Money and Shopping (Unit I) 
Your Spending Plan (Unit II) 
Using Credit (Unit III) 

2. JOBS 

Major Sources of Job Information (Unit I) 
How to Get in Touch with a Job (Unit II) 
The Job Interview (Unit III) 

3. LOOKING AHEAD IN LIFE 

4, SAFE TY 
Safety in the Home (Unit I) 

How to Prevent Children's Accidents in the Home (Unit II) 
Preventing Accidents of Older Adults in the Home (Unit III) 



SUMMARY 

Measures of the amount learned from these prd'grams Indicate that^ 
In general^ they led to sufficient degrees of learning to Justify thalr 
wider distribution to appropriate adult basic education students. 
More particularly^ JOBS and SAFETY lead to relatively superior amounts 
of learning^ while MONEY and LOOKING AHEAD led to^ approximately^ an 
adequate amount by previously establlsheu criteria. The students who 
usef| these programs generally evaluated them favorably^ though there 
were several relatively negative points In their evaluation forms. A 
sample of teachers for whom these programs are Intended^ Including 
those for whom data are leported herein^ generally evaluated the 
programs favorably^ though there were some negative points In their 
opinions^ too. The error rates for all programs were extremely low^ 
Indicating that the programs are successful by the error rate criterion^ 

In summary^ these may be generally regarded as successful 
programs^ especially by the major criterion for assessing effective- 
ness^ vlz.^ amount learned,^ 

I 
! 



For details pertaining to the methodology employed to test the 
effectiveness of the programs discussed In the present report, the 
reader Is referred to the publication by F. J. McGulgan and Robert J. 
Peters, Jr., entitled "Assessing the Effectiveness of Programmed Texts-- 
Methodology and Some Findings" (available from the Adult Learning Center) 
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MONEY 

Development Report 

Consumer Education was selected early In the history of the project 
as a broad subject matter area appropriate to the needs of the under- 
educated adult. A set of concepts from which educational objectives 
could be written was developed by consultanto from the Home Economics 
Division of the North Carolina Agricultural Extension Service. 

The summer of 1969, Mr. Robert G. Olsen Joined the project from 
Wilmington College where he was an Instructor of economics and business. 
Mr. Olsen 's task was that of developing self- Instructional materials 
In the area of consumer education. A review of the literature as a 
research project was made during the summer of 1969 In the areas of: 
the consuner behavior of the underprivileged; economic literacy 
programs In the self Instructional format; consumer education for thi= 
undereducated adult and existing programs In consumer education. In 
the fall of 1969 Mr. Olsen began writing a program around the concept, 
"The Role of the Consumer In the Market Economy. " Before this lesson 
was completed, Mr. Olsen was Instructed to develop three linear 
progranned booklets on the basic tasks of shopping, making a spending 
plan, and using credit. These booklets were developed under the 
guidance of a consultant. Dr. Rex Reynolds, of the University of 
Chicago. Before the third booklet, "Money and Using Credit," had 
been Initially tested, the Center employed another consultant In the 
area of educational technology. Dr. Barton Herrscher, of the Regional 

111 
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Educational Laboratories for the Carollnas and Virginia, Money and 
Credit was completed using the systems approach proposed by the 
Regional Laboratories, The other booklets were revised by writing 
behavioral objectives Internal to the booklets. Each of the original 
three booklets was tried out on a few students In the learning labora- 
tory of the Adult Learning Center approximately three times prior to 
the first printing, 

yfixen more Center personnel were released to work in the area of 
consimer education^ a survey was made to establish priorities for 
lesson development that helped somewhat in the validation process of 
the lessons. The lists of concepts were reduced to topics that could 
be identified by learners from the population^ and the enrolled students 
were asked to work in them in order of importance to their needs along 
with suggested lesson topics. The only conceptual topic that approached 
these in the general area of money management^ spending plans^ shopping 
ami using credit in ranking by students was that of insurance. 

The content validation of the four units and the initial multiple 
choice achievement tests were established through consultation arranged 
by Dr, Mary Louise Collings with Mrs, Justine Rozier^ Home Management 
Specialist^ Agricultural Extension Service^ North Carolina State 
University^ and Dr, Jack Wilson^ Ascociate Professor of Economics^ 
North Carolina State University, 

As a result of pre-testlng^ the achievement test called the 
"ALC Money Skills Test^" was revised. This revised instrument was 
initially utilised as a pre- and posttest for the four units in the 
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field outsJde the learning laboratory vlthln the Adult Learning 
Center. 

The four units on MONEY were again revised and field-tested 
during the spring of 1971 (see Programmed Instructional Materials for 
Adult Basic Education; Interim Report . August, 1971). During the 
spring of 1972 the original four units were thoroughly revised again 
and conden-jed Into a three unit series. Contained In the present 
report are the findings of the final revision and field test of the 
series. 
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JOBS » 

Developmental Report 
Lessons on JOBS , subdivided Into three unlts^ represent sets of 
micro-concepts In the area of the adult work world. The lessons were 
written for adults capable of reading at the fifth grade level. The 
original set of sub-concepts was selected by Dr. Don Reynolds who In 

1968 was an outside consultant to the Adult Learning Center. 

Dr. Reynolds' original material was subdivided Into five separate 
seffnents^ each of which was presented In a programmed Instructional 
format. 

The materials were received by the project staff and revised In 

1969 and 1970. The revised edition reflects a (1) reorganization of 
the concepts^ (2) a conceptual outline, and >i, (3) sequence of objec- 
tives. These are Included In a separate booklet entitled Instructor'^ 
Kanual. In addition, a pre- and posttest le. Included for each of the 
three separate units. 

All throe units of JOBS were empirically evaluated during the 
spring of 1971. The results of the field test Indicated th(i need for 
further revision before the materials were released for national 
distribution and use (see Programmed Instructional Materials for Adult 
Basic Education: Interim Report, August, 1971). 

During the spring of 1972 the series was again revised based upon 
the findings of the earlier field test. Contained In the present 
report are the research-based findings of the second, and final, field 
test. 

vi 
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PERSONAL AND FAMILY GOAT^ (LOOKIN G AHEAD IN LIFE) 

Developmentc 1 Report 
This Instructional unit represents a set of micro-concepts in the 
area of home management as originally identified by a number of con- 
sultants to the Adult Learning Center in 1967. 

A conceptual outline and schema of objectives for the unit were 
developed in 1968. The materiall were developed further through the 
assistance of Mrs. Minnie Brown and her staff from the Home Economics 
Division of the North Carolina State University Agricultural Extension 
Service in 1968. 

Programmed frames were developed from the set of objectives by 
the members of the staff of the Adult Learning Center. The first 
edition appropriate for adult basic education learners was prepared 
with illustrations in 1969. This edition was reviewed by the project 
staff and subsequently revised during the summer and fall of 1970 to 
include a pre- and posttest. The instructor's manual was included 
in the first edition. 

PERSONAL AND FAMILY GOALS was field-tested during the spring of 
1971 and found to be In t ^ed of further revision (see Programmed 
Instructional Materials i >r Adult B^sic Education; Interim Report . 
August; 1971). The materials were revised and further tested for 
effectiveness during the spring of 1972. The research- based findings 
of the final field testing are Included In the present report. The 
original PERSONAL AND FAMILY GOALS series has undergone a title change 
and Is referred to in this report as LOOKING AHEAD IN LIFE . 

vll 
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EMPIRICALLY BASED EVALUATIONS OF 
ADULT LEARNING CENTER PROGRAMS 

PROGRAM CHARACTERISTICS 

MONEY (Three booklets entitled Money and Shopping . Your Spending 
Plan and pBlng Credit) 



Purpose : 
Length: 

Students' Study Time : 

Reading Ease Score :* 
Human Interest Score: 



This series Is designed to facilitate 
money management for low Income 
families. 

The three units have a total of 71 
frames . 

An average of 21 minutes per booklet^ 
with a range of 15 minutes to 30 minutes. 

88.76 = Easy. 5th grade level. 

41.18 = Highly Interesting. 



JOBS (Three booklets entitled Majoi: Sources of Job Information . 
How to Get In Touch with a Jo b, and The Job Interview) 



Purpose : 



Length : 

Students' Study Time; 



Reading Ease Score :* 
Human Interest Score; 



itit 



The course of study on JOBS was 
written for those adult students who 
plan to seek a first Job^ or those 
presently employed but who may wish 
to acquire understanding In how to 
find out about job Information^ how 
to make Job contacts^ and how to 
successfully interview for a Job. 

The three units Involve 133 frames. 

An average of 2b minutes per book- 
let ^ with a range of 15 minutes to 
35 minutes. 

94.62 = Very Easy. 4th grade level. 
46.83 - Highly Interesting. 



*Rudolf Flesch, The Art of Readable Writing (New York: Harper and 
Brothers Pub Ushers ^ 1549), p. 149. 



**Ibid., p. 151. 
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LOOKING AHEAD IN LIFE 



Purpose : 



Length ; 

Students* Study Time ; 

it 

Reading Ease Score ; 
Human Interest Score;^ 



To provide a family with a basic 
knowledge of home management and 
to help It meet family and personal 
goals. 

The unit Involves 40 frames. 

An average of 33 minutes^ with a 
range of 30 minutes to 35 minutes. 

90.86 = Very Easy. 4th grade level. 

47.13 = Highly Interesting. 



SAFETY 



Purpose ; 



Length ; 

Students* Study Time ; 

if 

Reading Ease Score : 
Human Interest Score; 



ifit 



To provide adults who manage^ or 
assist In the management of^ a home 
with an understanding of how to make 
their home a safe place to live. 

The three units Involve 152 frames. 

An average of 50 minutes per unlt^ 
with a range of 20 minutes to 125 
minutes. 

92.44 » Very Interesting. 4th grade level. 
56.07 = Highly Interesting. 



TESTING CIRCUMSTANCES 

SUBJECTS AND LOCATIONS; The subject characteristics are 

summarized as follows: 

Menn Mean 
Highest Source Reading 

Mean Age Grade of Level and 

Location N Age Range Completed Gender Subjects Range 1. Q. 

Win. 8.3 

Durham #1 7 27 21-41 10.0 ^ Female Program 6-10 92 

12 Females NYC 6.8 
Durham ffi2 7 17 16-18 8.6 1 Hale Program 3.9-12.5 



*Rudolf Flesch, The Art of Readable Writing (New York: Harper and 
Brothers Publishers^ 1949) ^ p. 149. 

* *Ibld . , p. 151. 
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DATES OF TE8TIM9! August 1972 to Octobar 1972. 



atTIWC fyocgyjtt; Thi itudtnti vtrt glvta ta tehltvomt tost ts • 

pro-tost and thoa studlod at thalr own rata la 
tha prograa. A racord of working tlas was kapt. 
Thay took tha posttast whan thay had flnlshad 
thalr prograM, at which tine thay and tha taachars 
co^latad standard program ovaluatlon foma. Tha 
taachars did not assist tha studants la ockar than 
procadural aattars. 



RK8ULTS 



1. LEABNIMG DATA ! 

Tha achlavaaant tast scores for aach prograa ara 
prasantad In Tablas 1 - 10. It aay bo scan, for 
Instaaca, that tha asaa pra-tast scora for Malor 
Sourcas of Job Infofat^mi «t tha DurhM 
location vas 3.95. Aftar covlatlng tha prograa 
tha studants had a asan scora of 6.90; tha gain 
was thus 2.93. Tha Mount laanad, as Maaurad by 
tha tast, was larga, ralatlva to tha aaouat that 
could hava baan laamad, l.j., tha ratio of tha 
gain to tha aaouat of posslbla gain was .73 (tha 
G-Utlo)*. Using tha standard 0-tatlo of .30 as 
tha standard Indicative of sufflclant laamlng, It 
can ba saan that at Durhai #1, Unit #1 of JOM 
lad to adaquata Uamlng. This finding Is la 
accord with thosa at Durhaa #2. 

Laamlng data for tha othar two units of JOBS aay 
ba slallarly studlad In Tablas 2 and 3, whara It 
aay ba saan that both classas laamad substantially, 
as Indicated by aaan G-Utlos that wall axcaadad 
.30. 



Tha G values for the first unit of MONEY approached 
an Indication of a sufficient Mount of learning 
(Table A). A very high G value raMilted for Unit 2 
at Durhaa #1, though It was less iTDurhaa #2 
(Table 3), tha aaan of these two values exceeding 
.30. Slallarly, on the average. Unit #3 was suc- 
cessful by a learning criterion. We aay thus 
conclude that JOM aay lead to a satisfactory aaount 
of learning. 

♦The criterion of .30 has been standard In previous work «fui h«. k.... 
eaplrlcally Justified In tests of progr«i.ad I^^M^JoirSLS " 
aaterlals, c.f., HcOulgan, F. J. *1low to Select anu MvahUJTFrotraiii-d 
Instructional MaCarlals," Adult Uamlng Center Occasional Fa w#l 
North Carolina SUte University, Aprll7l971. 
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Table 1 



Learning Data for Major Sourcei 

of Job Information 

(Unit I) 

(Poislble Test Score * 8) 







Pre- 


Post- 






Test 




Test 


Test 






Location 


N 


Score 


Score 


Gain 


G- Ratio 


Durham #1 


7 


3.95 


6.90 


2.95 


.73 


Durham #2 


6 


1.95 


5.23 


3.28 


.54 
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TabU 2 



Lf rnlng Daf for How to 

G«t In Touch With a Job 
(Unit II) 



(Foil lb Ic Test Score 9) 



Test 

Locetlon N 

Durham #1 7 

Durham ^ 6 



Pre- Poat- 

Tait Teat 

Score Score 

3.00 7.43 

1.67 6.42 



Gain G-Ratlo 
4.43 .74 
4.75 .65 



5 
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Table 3 



Learning Pete for the Job Interview 
(Unit III) 



(Possible Test Score = 9) 



Test 

Location 


N 


Pre- 

Test 
Score 


Post- 
Test 

Score 


Gain 


G-Ratlo 


Durhem #1 


7 


5.71 


7.86 


2.15 


.65 


Durham #2 


6 


2.50 


6.17 


3.67 


.56 
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Table 4 



Learning Data for Money and Shopping 
(Unit I) 



(Poitible Test Score 10) 



Test 

Location 


N 


Pre- 
Test 

Score 


Post- 
Test 
Score 


Gain 


G- Ratio 


Durham #1 


7 


6.29 


8.00 


1.71 


.46 


Durham ^ 


7 


4.71 


6.86 


2.15 


.41 
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U'ble 5 



Learning Data for. Your Spending Plan 
(Unit II) 



(Possible Test Score 7) 



Test 

Location 


N 


Pre- 
Test 
Score 


Post- 
Test 
Score 


Gain 


.1 

G-Ratlo 


Durham #1 


7 


2.14 


6.21 


4.07 


.84 


Durham #2 


7 


2.29 


3.86 


1.57 


.33 



0 



8 
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Table 6 



Learning Data for Utlng Credit 
(Unit III) 



(Possible Test Score 13) 



Test 

I Location 
' Durham #1 
Durham #2 





Pre- 


Post- 






Test 


Test 




N 


Score 


Score 


Gain 


7 


7.71 


11.00 


3.29 


6 


4.75 


8.50 


3.75 
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The learning results for SAFETY are presented In 
Tables 7-9. There we can see that the G values 
for Units 1 and 2 clearly exceeded .50^ but that 
a low value resulted for Unit 3 at Durham #1. 
Nevertheless, the general conclusion Is that the 
three units of SAFETY led, on the average, to a 
sufficient amount of learning. 

The results for LOOKING AHEAD closely approximate 
the criterion of an adequate amount of learning 
(Table 10). 



STUDENT EVALUATIONS : 

The student reactions are presented In Tables 11-14 
along with the reactions of other students who used 
39 programs that have been previously tested. In 
this way the students' evaluations of these programs 
may be compared with a "norm" group. For example, 
Question ff^ asks, "How much do you think you 
learned from this program?" We can see that 18% 
of the students who used the 39 various other 
programs Indicated that they "learned very much. " 
In comparison 437* of those at Durham #1 who used 
MONEY said that they "learned very much," while 
147* of them said that they "learned quite a bit. " 
Detailed study of Tables 11-14 suggests that the 
students who studied these programs favorably 
evaluated them, though there are several relatively 
negative points. 



TEACHER EVALUATIONS ; 

A sample cc teachers for whom these programs were 
Intended generally considered their contents 
sound, and the levels appropriate for their students, 
though t\o of four thought that SAFETY was too easy 
(Table The amount that could be accomplished 

was. In general, rated somewhat unfavorably In their 
opinion. The attitudes of the teachers toward pro- 
granming were favorable, as can be seen In Item fft4. 
Perhaps of most Importance, the programs should be 
made nationally available, they generally thought 
(Item 6). In sumnary, we can regard the teachers' 
evaluations as generally, though not overwhelmingly, 
favorable. Specific comments offered by the teachers 
are as follows: 
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HOW TO MANAGE 

YOUR MONEY ; "ABE seudsnts «r« «lr«ftdy fuilll«r with this typt 
of Information." 

"Tht Mtorlal Is good sad Intsrs stint . After each 
unit It should b« dlscusssd. Hsrt we could check 
words and their neanlags." 

"Strong points: 

K Practical and useful Information 

2. Gave opportunity for students to 

plan their own budget. 

3. Vocabulary was easy to understand. 

Weak points: 

1. Insufficient explanation for figur- 
ing lnca>Be and outgo of exanples In 
Unit II - Your Spending Plan." 

"Best of 4 programs - did offer a few points, 
especially credit, Again, too elementary. 



JOBS ; "Strong points: 

1. The program gave useful Information 

2. Listing of programs In Job training 

In Unit I. 

3. Gave Information on exactly where to 

go for help, pointers on how to be 
successful in job contacts. 

4. The discussion of 'Me Attitude' venus 
'You Attitude' was a good topic to 
Include. More discussion and exaaples 
should have been Included on It. 

Weak points: 

1. Did not list exactly what students would 
have to know about themselves In order 
to fill out an application, such as dates 
they attended schools, social security 
number, names and addresses of refer- 
ffnces, etc. .A sample application blank 
could have been Included In one of the 
Units.*' 

"Too juvenile - merely common sense and Inappro- 
priate for adults." 

"This program Is fine. It gives the student an 
opportunity to be fair or cheat. To learn or not. 
He can correct his own mistakes. should review 
or discuss the subjects because they are so 
Important." 

11 
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*'ABE studtntt «ra alrtady fanlllAr with this type 
materUl - It more «ppllc«bl« for t««n-«ged 
•tudantt." 



LOOKING AHEAD 

IN LIFE ; "Strong points: 

1. W«ll-organlt«d MttrUl 

2. HatarUl ttuit will help students understand 

themselves better. 
Weak points: 

1. Vocabulary not explained sufficiently 

2. Needed nore exaaples of terns such as 

values, resouroas, goals." 

"Simply connon sense - no challenge." 



SAFETY : "ABE students already are faalllar with this 

material - more applicable for students In teens." 

"No challenge - a repetition of coanon knowledge." 

"Strong points: 

1. Practical Information needed for everyday 

living. 

2. Clear, precise, easy to follow Instructions 

for safety. 

3. Drawings were used to aid explanation - this 

was very helpful. 
Weak points: 

1. Too repetitious. The subject matter was one 
that did not need that much repetition." 
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A. 



ERROR ANALYSIS; 



It was determined that the mean error rates were 1.57* 
for JOBS, .13% for LOOKING AHEAD, 1.0% for SAFETY, 
and 1.9% for MONEY. A frequency dlatrlbutlon of error 
rates for 39 previously tested programs Is presented 
In McGulgan (op. clt.)* Relatively, all four programs 
under test here had extremely low error rates. It may 
thus be concluded that these ate successful programs 
by the error rate criterion. 
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Table 7 



Learning Data for Safety In the Home 
(Unit I) 



(Possible Test Score 15) 



/ 







Pre- 


Post- 






Test 




Test 


Test 






Location 


N 


Score 


Score 


Gain 


G-Ratlo 


Durham #1 


7 


8.90 


13.43 


4.53 


.74 


Durham #2 


7 


6.50 


11.64 


5.14 


.60 



14 
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Table 8 



Learning Daf for How to Prevent 

Children's Accidents in the Home 
(Unit II) 

(Possible Test Score 10) 







Pre- 


Post- 




Test 




Test 


" Test 




Location 


N 


Score 


Score 


Gain 


Durham #1 


7 


7.64 


9.29 


1.65 


Durham #2 


7 


6.36 


8.93 


2.57 



15 

25 



Table 9 



Learning Data on Preventing Accidents 

of Older Adults In the Home 
(Unit III) 



(Possible Test Score 8) 



Test 

Locat ion 
Durham #1 
Durham ^ 



N 


Pre- 
Test 
Score 


post- 
Test 
Score 


Gain 


G-Ratlo 


7 


6.14 


6.57 


.43 


.23 


6 


5.00 


6.50 


1.50 


.50 
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Table 10 



Learning Data on Looking Ahead in Lif e 



(Possible Test Score 10) 



Tnst 

Location 


N 


Pre- 

Test 
Score 


Post- 
Test 
Score 


Gain 


G- Ratio 


Durham §1 


7 


1.C4 


5.54 


3.90 


.47 


Durham §i 


5 


2.00 


5.75 


3.75 


.47 
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TabU 11 



Stud'int Evaluation! of MOMEY 



Question #1; Because a program as used In this course I believe: 



Test I learned 

Location _H_ aore 

39 Prograns 1870 7G% 

Durham #1 7 861 

Durham #2 5 601 



It made no 
difference 

18X 

14X 



I learned 
less 

12% 

Ofl 
20% 



Question #2: In comparing work done using the program with studying in 
regular textbooks I feel that with the same amount of time 
and effort: 



Test 

y^ocatlon N 

39 progms 

1869 

Durham #1 7 
Durham #2 S 



I learned I learned 

ouch 
more 

with the 
program 



301 
291 
01 



so— w h at 
more 

with the There Is no 
program difference 



391 
28% 
401 



n 

01 
01 



I learned 
somewhat 
more from 
studying 
textbooks 



15% 
43% 
40% 



I learned 

ouch 

more from 

studying 

textbooks 



9% 
0% 
201 



Question #3: If I vere to take another course In this subject, or a 
similar field, I would: 



Test 

Location 



N 



39Frogona 1866 
Durham #1 7 
Durham #2 5 



Prefer to have progr 
used for at least part 
of the course 

64% 
57% 
60% 



Mot care whether 
programs were 
used or not 

14% 
29% 
0% 



Prefer not 
to have 
programs used 

22% 
14% 

40% 
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Table 11 (continued) 



Question #4: How nuch do you think you leaiiied from thin program: 

Test Learned Learned Learned a Learned Learned 

Location N nothing a little meditm amount quite a bit very nuch 



39 programa 


1870 


2X 


15% 


31X 


24X 18% 


Durham #1 


7 


0% 


at 


43X 


14X 43X 


Durham #2 


5 


20% 


ox 


60X 


20X OX 


Question #5: 


To what extent did you enjoy going through ttiis program? 


Test 
Location 


N 


Very 

uncnjoyable Unenjoyable SO-SO 


Very 

Enjoyable enjoyable 


39 programs 


1871 


3% 




IIX 40X 


27X 19X 


Durham #1 


7 


OX ^ 




OX 43X 


43X 14X 


Durham #2 


5 


07. 




20X 40X 


40X OX 


Question #6: 


To what extent 


was the program repetitious? 


Test 

Location 


N 


Much too 
repeti- 
tious 


Too 
repetl 
tious 


Moderately 
- repeti- 
tious 


Slightly Not at all 
repetl- repeti- 
tious tious 


39 programs 


1862 


n 


17X 


41X 


267. 9X 


Durham #1 


5 


20X 


01 


60X 


20X OX 


Durham #2 


5 


401 


20X 


20X 


20X OX 
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Table 12 



Student Evaluations of JOBS 
Question #1: Because a program was used In this course I believe: 



Test 

Location N 
39 programs 1870 
Durham #1 7 
Durham #2 6 



I learned more 

701 
71% 
67% 



It made no 
difference 

18% 

291 

33X 



I learned lee; 
12X 

01 



Question #2: Ir ooparlng work done using the program with studying In 
regular textbooks I feel that with the same amount of tloe 
and effort: 







I learned 


I learned 




I learned 


I learned 






much more 


somewhat 




same%ihat 


much 






with 


more with 




more from 


■ore from 


Test 




the 


the 


There Is no 


studying 


studying 


Location 


N 


proKram 


prostam 


difference 


textbooks 


textbooks 


39 programs 


1869 


301 


39X 


7X 


15X 


9% 


Durham #1 


7 


57X 


01 


151 


14% 


14% 


Durham #2 


6 


331 


in 


331 


0% 


17% 



Question #3: If I were to take another course In this subject, or a 
similar field, I would: 



Test 
Location 



N 



39 programs 1866 
Durham #1 7 
Durham #2 6 



Prefer to have programs Not care whether Prefer not 

used for at least programs were to have 

part of the course used or not programs used 



64% 
43% 
501 



14% 
29% 
33% 



22% 
28% 
17% 



20 



ERIC 



30 



Table 12 (coritlnued) 

m 

r 

Question H: How nich do you think you learned from this program? 

Teat Learned Learned Learned a Leame'* Learned 

Location N_ no thing a little Medium amount quite a bit very much 



p&ogrttins 


1 snf\ 
io /u 




157. 


31X 


34X 


18% 


Durham #1 


7 


0% 


' 147, 


29X 


297. 


28X 


Durham #2 


6 


337« 


177. 


17X 


33X 


OX 


Question #5: 


To 


what extent 


did you enjoy going 


through this program: 


Lc'catlon 


N 


very 

unenjoyable 


Uiicnjoyable 50-50 


Enjoyable 


Very 

enjoyable 


39 programs 


1871 


3X 


UX 


40X 


27X 


19X 


Durham #1 


7 


15X 


OX 


57X 


14X 


14X 


Durham #2 


6 


17X 


OX 


33X 


5 OX 


OX 


Question #6: 


To 


what extent 


was the 


program repetitious? 




Test 
Location 


H 


Much tco 
repeti- 
tious 


Too 

repeti- 
tious 


Moderately 
repeti- 
tious 


Slightly 
repeti- 
tious 


Not at all 
repeti- 
tious 


39 programs 


1862 


n 


17X 


41X 


26X 


9X 


Durham #1 


5 


4051 


OX 


OX 


40X 


2 OX 


Durham #2 


6 


SOX 


17X 


17X 


16X 


OX 
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Table 13 

Student Evaluations of Looking Ahead In Life 

Question #1: Because a program was used In this course I bellevc>: 

Test It mad»«. no 

Location N I learned more difference I learned less 

39 programs 1870 707. 187. 12X 

Durham #1 7 86Z 14% 0% 

Durham #2 6 671 33% 0% 



Question #2: In comparing woik done using the program with study^*^g In 
regular textbooks I feel that with the same amount ^ 
time and effort: 







T learned 


I learned 




I learned 


I learned 






much more 


somewhat 




somewhat 


much 






with 


more with 




more from 


more from 


Test 




the 


the 


There lu no 


studying 


study^ g 


Location 


N 


program 


program 


difference 


textbooks 


textbooks 


39 pro, ms 


1869 






n 


. 15X 




Durhas #1 


7 


m 


437. 


14% 


01 


14% 


Durham #2 


6 


34X 


33X 


CfJL 


337. 


0% 



Question #3: If I were to take another course In this subject, or a 
similar field, I would: 

Prefer to have programs Not care whether Prefer not 

Test used for at least programs were to hive 

Location N part of the course used or not pronvrams used 

39 programs 1866 64% 14% 22% 

Durham #1 7 57% 29% 14% 

Durham #2 6 67% 17% 16% 
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Table 13 (continued) 



Question #4: How nuch do you think y':u learned from this program? 

Test Learned Learned Learned a Learned Learned 

Location N nothing a little medium amount quite a bit very much 



)9 Drofframs 


1870 


7X 


15% 


31% 


34% 


18% 


niiT*hAfn ^1 


7 

9 


141 


07. 


29% 


43% 


14% 


uurnoiM w 4m 


A 




50% 


0% 


33% 


17% 


Question #5: 


To 


what extent 


did you 


enjoy going through this program? 


Location 


N 


very 

unenjoyabl 


e Unenjoyable 50-50 


1 Enjoyable 


Very 

enjoyable 


39 programs 


1871 


3% 


11% 


40% 


27% 


19% 


Durham #1 


7 


0% 


29% 


43% 


28% 


0% 


Durham #2 


6 


0% 


0% 


50% 


50% 


0% 


Question #6: 


To 


what extent 


was the 


program repetitious? 




Teat 

Location 


N 


Much too 
repeti- 
tious 


Too 

repeti- 
tious 


Moderately 
repeti- 
tious 


Slightly Not at all 
repeti- repeti- 
tious tiuUS 


39 programs 


1862 


n 


17% 


41% 


26% 


9% 


Durham ^\ 


6 


01 


0% 


507. 


50% 


0% 


Durham 


6 


33Z 


17% 


33% 


17% 


07. 



33 
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Table 14 



Student Evaluations of Safety In the Home 

(Unit I) 



Question #1: Because a program was used In this course I believe: 

Test It made no 

Location N 1 learned more difference I learned less 

39 programs 1870 701 18X 127. 

Durham #1 7 57% 29X 14% 

Durham #2 6 83% 171 01 



Question #2: In coiuparlng vork done ualng the program with studying in 
regular textbooks I feel that with the same amount of 
tiJM and effort: 









I learned 




I learned 


I learned 






I learned 


somewhat 




somewhat 


much 






much more 


more with 




more from 


more from 


Test 




with the 


the 


There Is no 


studying 


studying 


Location 


N 


program 


program 


difference 


textbooks 


textbooks 


39 programs 


1869 


301 


m 


7X 


15% 


9% 


Durham #1 


7 


14% 




57% 


01 


0% 


Durham #2 


6 


33X 


501 


0% 


0% 


17% 



Question #3: If I were to take another course In this subject, or a 
slm^l'ar field, X would: 

Prefer to have programs Not care whether Prefer not 
Te«t used for «t least part programs were to have 
Location N of the course used or not programs used 



39 programs 1866 
Durham #1 7 
Durham #2 6 



64X 
147. 
67% 



147. 

57X 
337. 



221 
297. 
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Table 14 (continued) 



Question #4: How much do you think you learned from this program? 

T««t Learned Learned Learned a Learned Learned 

Locatloa N_ nothing a little medium amount quite a bit very much 



39 programs 


1870 


2X 


15% 


31X 






34X 18X 


Durham #1 


7 


29X 


141 


57X 






OX OX 


Durham #2 


6 


OX 


16X 


OX 






67X 17% 


Question #5: 


To what extent 


did you enjoy going 


through this program? 


Test 
Location 


N_ 


Very 

enjoyable 


Unenjoyable 50-50 


Very 

Enjoyable enjoyable 


39 programs 


1871 


3X 


UX 




40X 


27X 


19X 


Durham #1 


7 


291 


43X 




28X 


OX 


OX 


Durham #2 


6 


OX 


OX 




33X 


67X 


OX 



Question #6: To what extent was the program repetitious? 



Test 
Location 


N 


Much too 
repeti- 
tious 


Too 

repeti- 
tious 


Moderately 
repeti- 
tious 


Slightly 
repeti- 
tious 


Not at all 
repeti- 
tious 


39 programs 


1862 


7X 


17X 


41X 


26X 


9X 


Durham #1 


7 


43X 


14X 


OX 


29X 


14X 


Durham #2 


6 


OX 


OX 


34X 


33X 


33X 
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Table 15 



Suanary ot Teacher Evaluations* 



1. Sotmd Content? 2. Level of Content? 3. Aaount Accomplished? 

" Great 

Un- Too Appro- Too deal Little Little Much 

Program Title Yes No decided hard prUte easy - nore more Equal less less 



MONEY 
JOBS 



5 0 
4 0 



0 
1 



0 
0 



4 
4 



1 
1 



1 
0 



0 
1 



0 
1 



4 
3 



0 
0 



LOOKING AHEAD 

IN LIFE 2 2 

SAFETY IN 

THE HOME 3 1 



MONEY 



JOBS 



4. Program Pref^treoce? 

Pre- Not pre- Dom't 
ferred ferred care 



3 
3 



1 
1 



1 
1 



5. Program Enjoyable to Teacher? 

Very 

Very un- Unen- Enjoy- Enjoy- 

enjoyable joyable 50-50 a ble able 



0 
0 



2 
1 



2 
2 



L 



1 

0 



LOOKING AHEAD 
IN LIFE 

SAFETY IN 
THE HOME 



6. Should It Be Nationally Available? 
Yes No Don't know 



MONEY 
JOBS 

LOOKING AHEAD 
IN LIFE 

SAFETY IN TtC HOW 



4 
2 



0 
0 

1 
1 



1 
3 

1 
1 



*See the Appendix for a complete stateatnt of questions In Table 13 
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APPENDIX 



Teacher Rating Form 
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TEACHER EVALUATION FORhi 



Title of Program_ Name of Teacher 



The following questions were designed to help us evaluate the program 
that you have just gone through with your class. The information that 
you can furnish will be of great value to um. For each question please 
check the blank that you feel most adequately describes your opinion. 
Blank lines have been provided below each question for you to qualify or 
elaborate your answers. Please feel free to make any comments that will 
aid us in determining the value of this program. 

1. Is the subject-matter of the program acadeiuically sound: 

Yes 

No 

Undecided 



Conmients: 



2. Is the level of the subject: matter appropriate for your class? 

Too difficult 

Appropriate 

Too easy 

Comments: 



29 

38 



As contrasted with what you are able to accomplish with other types 
of learning material^ how much do you feel you are able to get your 
pupils to learn with this program? 

A great deal more than with most other materials. 

A little more than with most other materials. 



About as much as with other materials. 



A little less than with most other materials. 



So little as to be a waste of time. 



Comments: 



The next time you teaoh a course in this subject or a similar field^ 
would you: 

Prefer to have programs us^ed for at least part of the course? 

Prefer not to have progranjs used? 

Not care whecher programs are used or not? 



Comments: 



To what extent is this program enjoyable for your class? 

Very Unenjoyable 50-50 Enjoyable Very 

Enjoyable Enjoyable 

ComiT>.ents: 
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